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Abstract 

Quotient is a basic operation of formal languages, which plays a key role in the 
construction of minimal deterministic finite automata (DFA) and the universal 
automata. In this paper, we extend this operation to formal power series and 

pLn \ systemically investigate its implications in the study of weighted automata. In 

particular, we define two quotient operations for formal power series that coincide 
when calculated by a word. We term the first operation as (left or right) quotient, 
and the second as (left or right) residual. To support the definitions of quotients 
£> \ and residuals, the underlying semiring is restricted to complete semirings or com- 

plete c-semirings. Algebraical properties that are similar to the classical case are 

pq ■ obtained in the formal power series case. Moreover, we show closure properties, 

under quotients and residuals, of regular series and weighted context-free series 
are similar as in formal languages. Using these operations, we define for each 
formal power series A two weighted automata M.a and U A . Both weighted au- 
tomata accepts A, and M. A is the minimal deterministic weighted automaton of 



O 



X 



A. The universality of Ua is justified and, in particular, we show that M.a is a sub- 
automaton of IAa- Last but not least, an effective method to construct the universal 



5-1 . automaton is also presented in this paper. 
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1. Introduction 

In formal language theory, quotient is a basic and very important operation 
and plays a fundamental role in the construction of minimal deterministic finite 
automata (DFA). Given a formal language L over an alphabet E, the left quotient 
u~ 1 L of L by a word u is defined as the language {v E T,*\uv E L}, where E* is 
the free monoid of words over E. The famous Myhill-Nerode Theorem then states 
that Lisa regular language if and only if the number of different left quotients of L 
(also called the quotient complexity |4|] of L) is finite. Moreover, a minimal DFA 
which recognizes L can be constructed in a natural way by using left quotients as 
states. In particular, this means that the quotient complexity of L is equal to the 
size of the minimal DFA which recognizes L. 

The notion of left quotient of a formal language by a word can be extended to 
quotients by a formal language in two ways. Given two formal languages L, X, 
the left quotient of L by X, denoted by X~ 1 L, is defined as the union of u~ 1 L 
for all words u in X. Another extension is less well-known, if not undefined at 
all. We define the left residual of L by X, denoted by X\L, as the intersection 
of u~ x L of all words in X. Similarly we have LX _1 , the right quotient of L 
by X, and L/X, the right residual of L by X. Regarding each left residual of 
L as a state, there is a natural way to define an automaton, which is called the 
universal automaton IM2M of L. The universal automaton of a formal language 
L contains many interesting information (e.g. factoraization) of L [25] and plays a 
very important role in constructing the minimal nondeterministic finite automaton 
(NFA)ofL|Ell2l. 

Former power series are extensions of formal languages, which are used to 
describe the behaviour of weighted automata (i.e. finite automata with weights). 
Weighted automata were introduced in 1961 by Schiitzenberger in his seminal 



paper 113011 . A formal power series is a mapping from E*, the free monoid of 
words over E, into a semiring S. Depending on the choice of the semiring S, for- 
mal power series can be viewed as weighted, multivalued or quantified languages 
where each word is assigned a weight, a number, or some quantity. Weighted au- 
tomata have been used to describe quantitative properties in areas such as proba- 
bilistic systems, digital image compression, natural language processing. We refer 



to niOTI for an detailed introduction of weighted automata and their applications. 

Despite that a very large amount of work has been devoted to the study of for- 
mal power series and weighted automata (see e.g. fl20ll29[ |2i ll0l ll4ll for surveys), 



the important concept of quotient as well as universal automata has not been sys- 
tematically investigated in this weighted context. The only exception seems to be 



yD, where the quotient of formal power series (by word) was discussed in pages 
10-11. When the semiring is complete, it is straightforward to extend the defi- 
nition of the quotient of a formal power series A from words to series: we only 
need to take the weighted sum of all left quotients of A by word in E. Our attempt 
to characterize the residual of a formal power series A by a formal power series 
as the weighted intersection of all left quotients of A by word in E is, however, 
unsuccessful. Several important and nice properties fail to hold anymore. 

The aim of this paper is to introduce the quotient and residual operations in 
formal power series and study their application in the minimization of weighted 
automata. To overcome the above obstacle with residuals, we require the semiring 
to be a complete c-semiring (to be defined in Section 2), and then give a charac- 
terization of residuals in terms of quotients by word. Many nice properties and 
useful notions then follow in a natural way. 

The remainder of this paper is organized as follows. Section 2 introduces 
basic notions and properties of semirings, formal power series, and weighted au- 
tomata. Quotients of formal power series are introduced in Section 3, where we 
also show how to construct the minimal deterministic weighted automata effec- 
tively. In Section 4, we introduce the residuals and factorizations of formal power 
series. Using the left residuals, we define the universal weighted automaton Ua 
for arbitrary formal power series A in Section 5, and justify its universality in Sec- 
tion 6. An effective method for constructing the universal automaton is described 
in Section 7, which is followed by a comparison of the quotient and the residual 
operations. The last section concludes the paper. 



2. Preliminaries 

We recall in this section the notions of semirings, formal power series, weighted 
jmata, and weighted contex-free g 
fill H S, H for more information. 



automata, and weighted contex-free grammar. Interested readers are referred to 



2.1. Semirings 

A 5-tuple S = (S, ©, ©, 0, 1) is called a semiring if S is a set containing at 
least two different elements and 1, and © and © are two binary operations on S 
such that 

(i) © is associative and is commutative and has identity 0; 

(ii) © is associative and has identity 1 and null element (i.e., a©0 = 0©a = 
for all a E S); and 



(iii) ® distributes over ©, i.e., for all a,b,cE S,a®(b(&c) = (a © 6) © (a Cg> c) 
and (6 © c) © a = (b <g> a) © (c © a). 

Intuitively, a semiring is a ring (with unity) without subtraction. All rings (with 
unity), as well as all fields, are semirings, e.g., the integers Z, rationals Q, reals R, 
complex numbers C. Lattices provide another important type of semirings. Recall 
that a partially ordered set (L, <) is a lattice if for any two elements a,b E L, the 
least upper bound aWb = sup{a, b} and the greatest lower bound a Ab = inf {a, b] 
exist in (L, <). A lattice (L, <) is distributive, if a A (b V c) = (a A 6) V (a A c) 
for all a,b,c E L; and bounded, if L contains a smallest element, denoted 0, and a 
greatest element, denoted 1. Let (L, <) be any bounded distributive lattice. Then 
(L, V, A, 0, 1) is a semiring. Because a distributive lattice L also satisfies the dual 
distributive law a V (b A c) = (a V 6) A (a V c) for all a,b,c E L, the structure 
(L, A, V, 1, 0) is also a semiring. 

Other important examples of semirings include: 

- The Boolean semiring 1 = ({0, 1}, V, A, 0, 1); 

- The semiring of the natural numbers (N, +, •, 0, 1) with the usual addition 
and multiplication; 

- The tropic semiring (N U {oo}, min, +, oo, 0) with min and + extended to 
N U {oo} in a natural way; 

- The min- sum semiring of nonnegative reals (R + U {0, oo}, min, +, oo, 0); 

- The semiring of (completely positive) super-operators on a Hilbert space H 
(SO(H), +,o,0 H ,T H ). 

We note in the last semiring the addition is not idempotent and the product is not 
commutative. This semiring is recently used in model checking quantum Markov 



chains 111711 and the study of finite automata with weights taken from this semiring 



just initiated. 

2.1.1. Complete Semiring 

Let I be an index set and let S be a semiring. An infinitary sum operation 
J2j : S 1 — > S is an operation that associates with every family {a^i E 1} of 
elements of S an element J2i^i a i °f &• A semiring S is called complete if it has 
an infinitary sum operation Y^i f° r eacn index set / and the following conditions 
are satisfied: 



(i) Eig0 <k = 0, Eie{i} a i = a J> and T,ie{j,k} a i = a i © a k for J ^ k. 
(ii) E i6 j Eieij o< = E*6/ a i if U e j ^ = l and I,- n 4 = for j ^ k. 
(iii) Eie/( a © c^) = a © ]T\ e/ a* and E ie /( a i ® a ) = E; e i a * ® a - 

This means that a semiring S is complete if it is possible to define infinite sums 
(i) that are extensions of the finite sums, (ii) that are associative and commutative, 
and (iii) that satisfy the distributive laws. 

2.1.2. Complete c-Semiring 

A semiring S is a c-semiring if © is idempotent (i.e., a ® a = a for all a E S), 
(8) is commutative, and 1 is the absorbing element of © (i.e., a © 1 = 1 for any 
a G S). In general, for a semiring S, we define a preorder < s over the set S by 

a <5 b iff a © c = b for some cG S. 

If © is idempotent, then < 5 is also a partial order. Suppose S is a c-semiring. For 
any a,b G S, we have <^ a < s 1 and a © b = a V b (the least upper bound of 
a and 6) in the poset (5, <s). If S is clear from the context, then S is omitted and 
we simply write < for < s in the following. 

A semiring S is called a complete c-semiring if 5" is a complete semiring and 
a c-semring. In a complete c-semiring, the infinitary sum Y^iPi a i ^ s e xact ly the 
least upper bound of o, (i G J) in 5 under the induced partial order < s . In this 
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case, Eie/ a * ^ s a ^ so wr i tten as V 

Complete c-semiring is a special kind of the notion of quantale Il27ll . which is 
a complete lattice L equipped with a multiplication operator © such that (L, ©) is 
a semigroup satisfying the following distributive laws: 

\j '(a © a^ = a <g>\J ' a { , y (a* <g) a) = y a^ © a. (1) 

Since the infinite distributive laws (Eq. (D holds, there are two adjunctions or 
residuals, denoted a\b (left residual) and b/a (right residual), respectively, satis- 
fying the following adjunction (residual) conditions, 

x < a\b iff a © x < b, and x < b/a iff x © a < 6 (2) 

When the given quantale is commutative, i.e., the operation © is commutative, 
then the left residual is the same as the right residual. In this case, we call the left 



residual (and the right residual) the residual, denoted by a — > b. Then we have 

a -^b = \J{x\a®x < b}. (3) 

We have the following proposition. 

Proposition 1. Let S be a complete c-semiring. Then S is a commutative quantale 
with unit 1 as the largest element of S. 

2.2. Formal Power Series 

Let E be an alphabet and S a semiring. Write E* for the set of all finite strings 
(or words) over E, and write e for the empty string. Then E* is the free monoid 
generated by E under the operation of concatenation. We write E + for all finite 
non-empty strings over E. A formal power series A is a mapping from E* into 
S. For simplicity, we also call a formal power series as a series, or an S-subset of 
E*. The value of A at a word w E E* is denoted (A, w) or A(w) in this paper. We 
write A as a formal sum 

A=£(A,u;K (4) 

where the values (A, w) are referred as the coefficients of A. The collection of all 
power series A as defined above is denoted by S((E*)). For a series A, if A(e) = 0, 
then A is called proper. For any series A, A can be written as the sum of a proper 
series and and non-proper series, i.e., 

A= (A,e)e+ ^2(A,w)w. (5) 

For s series A on E, the support of A is defined as 

supp(A) = {we Ti*\{A,w) ^0}. (6) 

For two series A and B in S((T,*}), we define A < B whenever A(w) <s 

B(w) for any w E E*. 

2.3. Weighted Automata 

Weighted automata are an extension of the classical finite automata. 



Definition 1. Let S be a semiring. A weighted automaton with weights in S is a 5- 
tuple A = (Q, E, 5, J, F), where Q denotes a set of states, E is an input alphabet, 
<5 is a mapping from Q x E x Q to S, and 7 and F are two mappings from Q to 5. 
We call A a finite weighted automaton if both Q and E are finite sets; We call A a 
deterministic weighted automaton (DWA for short) if 5 is crisp and deterministic, 
i.e., 5 is a mapping from QxS into Q, and I = q E Q. 

The mapping 5 is called the weighted (state) transition relation. Intuitively, 
for any p,q E Q and a E E, <J(p, a, q) stands for the weight that input a causes 
state p to become q. I and F represent the (weighted) initial and, respectively, 
final state. For each q E Q, I(q) indicates the weight that q is an initial state, F(q) 
expresses the weight that q is a final state. 

Remark 1. Our definition of deterministic weighted automaton is different from 
the one used in e.g. [5], where a weighted automaton A = (Q, E, 5, 1, F) is 
deterministic or sequential if there exists a unique state q in Q such that /(go) ¥" 
and for all q E Q and all a E E, there is at most one p E Q such that S(q, a, p) ^ 0. 

These two definitions are not identical in general. In fact, deterministic weighted 
automaton called in this paper is just the simple deterministic weighted automaton 
defined in Q3D , for the detail comparison, we refer to IpillOll. A simple determinis- 



tic weighted automaton is obviously a sequential weighted automaton defined in 
B5D. The following example shows that the converse does not hold in general. Let 
S = (N U {oo}, min, +, oo, 0) be the tropical semiring. Suppose E = {a} and A 
is the formal power series over E defined by A(w) — \w\, where |iu| denotes the 
length of the string w. Then A can not be accepted by any simple deterministic 
weighted automaton (see Proposition HJbelow). However, A can be accepted by a 
sequential weighted automaton A = ({<?}, E, 5, {q}, {<?}), where 5(q, a,p) — 1 if 
p = q and 5(q, a,p) = otherwise. 

If S is locally finite, however, then the two definitions are equivalent in the 
sense that they accept the same class of former power series, where a semiring is 



locally finite if every sub-semiring generated by a finite set is also finite llllh . 
Two weighted automata can be compared by a morphism. 

Definition 2. A homomorphism (or morphism) between two weighted automata 

A = (Q, S, <5, J, F) and B = (P, E, 77, J, G) is a mapping (p : Q — ^ P, satisfying 
the following conditions: 

I(p) < J(<p(p)), F(p) < G(cp(p)) and S(p, a, q) < r)(<p(p), a, <p(q)), (7) 

for any p,q E Q and a E E. 



A morphism ip is surjective if (p : Q — > P is onto and B = (P, X, (p(S), <p(I), 
<p(F)), where 

(p(5)(p 1 ,<J,p 2 ) = ^2{S(q 1 ,a,q 2 )\<p{pi) = quffo) = Q2}, 

<P(I)(P) = £{J(?)Mp) = ?}. 
¥>(F)(p) = ^{F(g)|^(p) = g}. 

In this case, i3 is also called the morphic image of A. 

If </> : Q — V P is one-to-one, then we call A a sub-automaton of <6. 
A morphism yj is called a strong homomorphism if 

J(p) = £{J(?Mff)=p}, 

v(<p(q),<t,p) = ^2{fi(q,<7, r )\<p( r ) = p}- 

In case ip is an onto strong homomorphism, we call B a quotient of A 

We say (p is an isomorphism if it is bijective and its inverse , p~ 1 is also a 
morphism. In this case, we say A is isomorphic to B. 

The behaviour of a weighted automaton is characterized by the formal power 
series it recognizes. To introduce this formal power series, we extend the weighted 
transition function 5: QxY>xQ^-S to a mapping 5* : Q x YT x Q — y S as 
follows: 

(i) For all p E Q, set 6* (q, e, p) — 1 if p = q, and 6*(q, e, p) = otherwise; 
(ii) For all 9 — (?\ ■■• cr n E £*, define 

S*(q,cr 1 ---cr n ,p) = ^{Sjq, q x , gi)®- • -®<?(gn-i» °"n,p)ki, • • • , gn-i <= Q}. 

If .4 is deterministic, the extension 5* of transition function <5 is defined similar as 
in the classical case. It is easy to see that for any 9 = 9\9 2 E X* we have 

S*(q, 9 1 9 2 ,p) = J}<F*(g, 9 1 , r) <g> <T(r, 2 ,p)]. (8) 

reQ 



Definition 3. For a weighted automaton A = (Q,T,,5,I,F), the formal power 
series recognized or accepted by A, written |^4| : E* — > S, is defined as follows: 

W) = £)U(p) ® <F"(p,0,<z) ® F(g)b,g 6 Q}. (0 6 E*) (9) 
If .A is deterministic, then the formal power series recognized by A is defined as 

\A\(6)=F(5*(q ,6)). (tfeE*) (10) 

We say a formal power series A E S ({£*)) is a regular series or an S-regular 
language on E if it is recognized by a finite weighted automaton; and say A is a 
DWA-regular series or a DWA-regular language on E if it is recognized by a finite 
DWA. 



It was proved by Schiitzenberger yOJ that regular series are precisely the ra- 
tional formal power series for all semirings. So we also say a regular series as a 
rational series in this paper. 

2.4. Weighted Contex-Free Grammar 

We next recall the concept of weighted context-free grammar and weighted 
context-free series. 

A weighted context-free grammar is in essence a classical context-free gram- 
mar together with a function mapping rules of the grammar to weights in a cer- 
tain semiring ( IIKX Il4ll ). Let S be a semiring. A weighted context-free grammar 
(WCFG) is defined as a tuple G = (E, N, Z , S, P), where E (the set of termi- 
nal symbols) and N (the set of non-terminal symbols) are two finite sets that are 
disjoint, Z (the start or initial symbol) is an element in N, P is a mapping from 
N x (N U E)* (the set of productions or rules) to S. 

Similar to the classical case, we can define the induction of a weighted context- 
free grammar G. Suppose Z — > 7 is a weighted production, and a, (3 are elements 
in (N U E)*. We say <yy[3 is a direct induction of aZf3 with weight r, denoted by 

aZ[3 =^» ccy/3. For productions ai, • • • , a*, in (iVUE)*, if ai =£■ a 2 , • • ■ , afc-i =>- 
a*;, then we say «& is an induction of «i with weight r = r*i <S> • • ■ <8> r fc _!, denoted 
by «i =^* afe. The formal power series \G\ generated by G is defined as |G| (w) = 
J2{ r \Zo =>* w} (w G E*). A series A is called context-free if there is a weighted 
context-free grammar G such that A = \G\. 



2.5. Operations of Formal Power Series 



We recall several well-know operations of formal power series (cf. Il24ll ). For 



two formal power series A, B E S ((Y,*)) , & value r E S, and w E E*, we define 

(A@B)(w) = A{w)@B{w), (11) 

(AB)(w) = S ^{A(w 1 )®B(w 2 )\w 1 w 2 =w}, (12) 

(rA)(w) = r®A(w), (13) 

(Ar)(w) = A{w)®r, (14) 

A*(w) = ^2{A(w 1 )®---®A(w n )\n>0,w 1 ---w n = w}, (15) 

A R (w) = A{w R ), (16) 

where w R — a n - ■ ■ o 2 0\ if w — (J\(Ji ■ ■ ■ <J n . We call A © B and AB the sum and, 
respectively, the concatenation (or Cauchy product) of A and B, and call rA, Ar, 
A*, and A R the left scalar product, the ng/i? scalar product, the Kleene closure, 
and the reversal of A, respectively. 

Given a weighted automaton, .4. = (Q, E, 5, /, F), three other operations can 
be defined for the formal power series recognized by A. For any two states p, q in 
Q, and any 9 E E*, we define 

Past A (q)(8) = ^{I(p)®6*(p,8,q)\peQ}, (17) 

Fut A (q)(8) = ^{F(q,e,P)®F(p)\peQh (18) 

Tran^(p,g)(^) = «T(p,0,g). (19) 

The following result holds. 

Proposition 2. Suppose A = (Q, E, 5, /, F) is a weighted automaton. For any 
q E Q, we have 

Past A (q)Fut A (q) < \A\. (20) 



10 



Proof. For any 9 G E*, we have 

(Past A (q)Fut A (q))(6) 
= Y^ p a st A(q) (u) (8) Fut A (q) (v) 

uv=9 

= J2 J2l(Qo)®S*(qo,u,q)® J25*(q,v,p)®F(p) 

uv=G qo£Q p£Q 

= J2 J2 I(q ) ® 5*(q ,u,q) ® 5*(q,v,p) ® F(p) 

uv=6 qo,p&Q 

< Yl J2 I(q )®5*(q ,u,q)®5*(q,v,p)®F(p) 

uv=9 qo,p,q&Q 

= Y I (lo)<S)5*(qo,uv,p)(g)F(p) 

uv=9 

= \A\{0). 
Hence, Past A (q)Fut A (q) < \A\. D 

3. Quotients of Formal Power Series 

In this section, we first introduce quotients of formal power series and then, 
upon this operation, introduce for each formal power series A a canonical weighted 
automaton that recognizes A. Properties of the quotient operation is also studied. 

3.1. Quotients and Minimal Weighted Automata 

Let A : E* — > S be a formal power series, u E E* a word. The left quotient of 
A by u, written u~ 1 A, is the formal power series u~ l A : E* — > S defined as: 

u~ l A(v) = A{uv) [v 6 £*). (21) 

Dually, the right quotient of A by u, written Au~ x , is the formal power series 
An' 1 : E* -»■ 5 defined as: 

Au" 1 ^) = A(vu) 6 E*). (22) 

for any u G E*. 

The left quotient operation introduces an equivalent relation on E*. 

Definition 4. Suppose A G S((L*)). We say two words iti and u 2 are norc- 
distinguishable in A, written iti =a ^2> if u^ l A = u^A, i.e., if A(u\u) = 
A(u 2 u) for all u G E*. 

11 



It is straightforward to show that = A is an equivalent relation on E*. For each 
word u G E*, we write [u]a for the equivalent class of =a that contains u. 

Lemma 1. Suppose A G 5((E*)). 77ze mapping defined by [u] >->■ u~M (u G E*) 
w a bijectionfrom the set of equivalent classes o/=a to the set of left quotients of 
A. 

We define a deterministic weighted automaton M. A = (Qa, E, <5a, /a, -Pa) as 
follows: 

• Qa = E*/ =a is the quotient of E* modulo =a; 

• <5a : Qa x E — > Qa is defined as 

5 A ([6},a) = [9a}, (aeE*) (23) 

• /^ is the singleton state [e] in Qa; 

• F A : Q A ->■ 5 is defined by i^flfl]) = A(0) for G E*. 

Proposition 3. Suppose A G S((T,*)). 77?en A^a w ^ minimal DWA that recog- 
nizes A. 

It is easy to see that 5a is well-defined and, hence, A4a = (Qa, E, 5a, Pa, -Pa) 
is a DWA. It is straightforward to show that M. a recognizes A. In other words, 
there is a DWA A that accepts A for any formal power series A. In general, A4a 
is not finite; but, when it is finite, M.a is the minimal DWA that recognizes A. 

By Lemma [H an equivalent minimal DWA 

M' A = (Q' A ^,S' A ,I' A ,F A ) (24) 

that recognizes A can be constructed by using the left quotients of A as follows 

• Q'a = {u~ l A\u G £*}, the set of all left quotients of A by a word; 

• 5' A : Q' A x E -»■ Q'^ defined by 

^(M- 1 A,«r) = («ff) -1 i4 (25) 

• I' A = A = e- l A; 

• i^ : Q' A -»■ 5 is defined by i^(u _1 A) = A(u) for G E*. 

12 



The following proposition presents a characterization of formal power series 
that can be recognized by a finite DWA. 

Proposition 4. Suppose A G S((E*)). Given r G S, we write Im{A) = {A{9)\9 G 
S*}, A r = {9 G E*\A(9) > r}, and A [r] = {9 G E*\A(9) = r}. Then the 
following statements are equivalent. 

(i) A can be recognized by a finite DWA. 

(ii) Im(A) is finite and each A r is a regular language for r G Im(A). 

(Hi) Im(A) is finite and each Am is a regular language for r G Im(A). 

(iv) There exist n, • ■ ■ , r^ G S \ {0} and k regular languages L l5 ■ • • , L k over 
E, which are pairwise disjoint, such that A = Yli=i r i^i- 

(v) =a has finite index, i.e., Qa is finite. 



Proof. The proof is similar to that given for lattices in [|24U23ll . □ 



But when can a regular series be recognized by a finite DWA? This is closely 
related with the structure of semiring S. It can be shown that ("cf. 112411 '). for any 
regular series A, A can be recognized by a finite DWA iff the monoid (S, ©, 0) 
and (S, (g), 1) are both locally finite, where a monoid (M, x, 1) is locally finite if 
every submonoid generated by a finite subset of M is also finite. In particular, if 
S is finite, regular series and DWA-regular series are the same. 

3.2. Properties of Quotients 

The left quotient of a series A by a word u can be regarded as a left action of 
£* on S ((£*)), i.e., a mapping S* x S ((£*)) -> S((E*)). The action satisfies the 
following conditions. 

Proposition 5. Let S be a semiring. Suppose A G S((T,*)), e is the empty word in 
E*, u, v are words in E*, and k is a value in S. Then we have 

(i) (uv)~ l A = ir^u^A), A^uv)" 1 = (Av~ l )u- 1 , e~ l A = A = Ae~ l ; 

(ii) u~ l (A ®B)= u~ x A © u^B, (A © B)u~ l = Au~ l © Bu" 1 ; 

(Hi) u~\kA) = k{u- l A), u~\Ak) = {u~ l A)k, (kA)u~ l = k(Au' 1 ), (Ak)u~ l 
= (Au~ l )k. 



13 



Proof. Straightforward. □ 

When the semiring S is complete, the left quotient operation can be extended 
from words to series in a natural way. Let A, X be two formal power series in 
S {{£*)). We define the left quotient of A by X, denoted by X~ l A, as 

X~ l A(v) = J2 X(u)(u~ l A)(v) = J2 X{u)A{uv). (v G £*) (26) 

Similarly, we can define the right quotient of A by Y for any Y G S ({£*)), 
denoted by AY^ 1 as 

AY- X {v) = J2 A( VU ) Y ( U )- ( v G s *) ( 27 ) 

It is easy to see that when the formal power series X is a word u, then 
X~ l A = u~ l A and AX' 1 = AvT 1 . We summarize some algebraic properties 
of the quotient operation. 

Proposition 6. Let S be a complete semiring. Suppose A,X X ,X 2 G S 1 ((£*)). 
Then 

(i) (X t © X 2 )- 1 A = XI 1 A © X 2 X A, A{Y X © Y 2 )~ l = AYf 1 © AY 2 \ 

(ii) X-\A X © A 2 ) = X~ X A X © X~ l A 2 , (A x © A 2 )Y~ 1 = A x Y~ l © A 2 Y~\- 

(Hi) (X*)~ l A = A® (X^iX^A), A(Y*)~ l = A® {AV 1 )^*)- 1 ; 

(iv) X-\AB) = {X- 1 A)B@{A- 1 X)- l B, (AB)Y^ 1 = A(BY~ l )@A{YB~ l y l ; 

(v) (rX)~ l A = r(X~ l A), X~ l (Ar) = (X _1 A)r, (rA)Y~ 1 = r(AY~ l ), 
A{YrY l = (AY~ l )r; 

(vi) If Sis commutative, then {XxX^A = X^X^A), AiY^y 1 = (AYf^Yf 1 . 

If the semiring S is commutative, the following lemma shows that the right 
quotient is dual to the left quotient, where the reversal operation X R is defined 
(see Eq. [16]) as X R (o\0 2 ■ ■ ■ <J n ) = X(a n ■ ■ ■ a 2 Oi) for any w = a x a 2 ■ ■ ■ a n . 



14 



Lemma 2. Suppose S is a complete semiring. ForA,X,Y £ 5 ((£*)), ifY{u)A{vu) 
A{yu)Y{u), A(uv)X(u) = X{u)A{uv) for any u,v £ £*, then 

AY- 1 = ((Y R y l A R ) R (28) 

X~ X A = (A R (X R y 1 ) R - (29) 

In particular, if A is a classical language, i.e., Im(A) C {0, 1} or if S is commu- 
tative, the above equalities hold. 

Proof. Straightforward. □ 

By the above result, if the semiring S is commutative, then the right quotient is 
dual to the left quotient by the reversal operation. Properties of the right quotient 
can be dually obtained in this case. 

3.3. Closure Properties of Former Power Series under Quotient 

In this subsection, we study the language properties of the quotient of series. 
We first recall a preliminary result which will be used in the proof. 



Lemma 3 (cf. lUOll ). Suppose Y is a proper and regular series in S ((£*)). Then 
there exists a weighted automaton A = (Q, E, 5, g , {<?/}) that recognizes Y such 
that go 7^ Qf and S(q, a, go) = Ofor any q £ Q. 

Proposition 7. Let S be a complete semiring. Suppose A,X,Y are former power 
series in £((£*)). Then 

(i) If A is regular, then X~ l A and AY~ l are regular. 

(ii) If A is DWA-regular, then X~ X A and AY' 1 are DWA-regular. 

(Hi) For a commutative semiring S, if A is context-free, X and Y are regular, 
then X~ X A and AY -1 are context-free. 

(iv) If A is context-free, X and Y are DWA-regular, then X~ l A and AY^ 1 are 
context-free. 

Proof. See Appendix A. □ 

Using the quotient of a series A by a series, we have a related deterministic 
weighted automaton 

B A = ({X-'AIX £ S({E*))},E,S,A,F), (30) 
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where 8{X- X A, a) = (Xa)~ l A, and F(X~ l A) = J2 u ss* X{u)A{uv). Because 
the accessible part of Ba is the minimal DWA M! A (cf. (I24)) '). hence \Ba\ = A. 

Recall in the classical case, if A is a regular language over E, then {X _1 v4|X C 
E*} (the set of all left quotients of A by languages) is a finite set. This does not 
hold in general. In fact, the fmiteness of Q = {X~ l A\X C S((E*}}} heavily 
depends on the fmiteness of the semiring S. 

Proposition 8. Let S be a semiring. Then S is finite if and only ifBA is finite for 
any DWA-regular series A in S ((£*)), where Ba is the weighted automaton that 
recognizes A defined in rfjQl ). 

Proof. Suppose Ba is finite for any DWA-regular series A. In particular, Ba is 
finite for A = E*. Take a E E, for any r E S, let X r = ra (which is a series over 
E). By a simple calculation, the left quotient X~ X A is Y^weT,* rw > i- e -' X^A = r, 
where r(w) = r for any w E E*. Then, as a subset of {X~ l A\X E S((T,*))}, the 
set {r\r E S} is finite. Hence, S is a finite set. 

Conversely, suppose S = {r 1; • • • ,r fc } is finite. For any X E S((T,*}}, let 
Xi = {w E E*\X(w) = r,i\. ThenX = J2i=i r i-^i- Since A is regular, there exist 
finite regular languages L\, ■ ■ ■ , L k such that A = J2 i=1 TiLi. By Proposition [6l 
it follows that X~ l A = J2i=i Z],=i( r * ® r j)^r 1 ^ J j- Since Lj is regular, the set 
{X^LAX C E*} is finite. It follows that the set {X~ l A\X E 5((E*)}} is also 
finite. □ 

In the remainder of this paper, we will consider the residual operations on 
formal power series. 

4. Residuals and Factorizations 

In this section, we study the residuals and factorizations of formal power se- 
ries. For A, X E S ({£*)), the left residual of A by X, written as X\A, is defined 
as the largest Y E S((E*)) such that XY < A. Similarly, we define the right resid- 
ual of A by X, written as A/X, as the largest Y E S((E*)) such that YX < A. 
We note that X\A and A/X need not exist for all A, X. 

4.1. Residuals of Formal Power Series 

The following proposition shows that residuals always exist when S is a com- 
plete c-semiring. We recall that each c-semiring is commutative. 
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Proposition 9. Suppose S is a complete c-semiring. For any A,X,Y G S((E*)), 
X\A and A/Y do exist and we have 

X\A = J2i Z \ XZ < A }' (3D 

A/Y = ^{Z\ZY < A}. (32) 

Proof. Because S is a complete c-semiring, we know J2iei Zi ex i sts f° r an Y SUD ~ 
set {Zi\i G 1} of S((E*)). Moreover, the concatenation operation satisfies the 
following conditions: 



x(52 Y *) = zZ XY ^ < 33) 

C£^)x = /Z YiX - ( 34 > 

iei iei 

That is to say, S {{£*)) is a quantale under the operations J2 an ^ concatenation. It 
is then easy to see that X(J2i Y \ XY < A }) < A and hen ce J2i Y \ XY < A } is 
the largest Z such that XZ < A, i.e., A\Y = J2i Y \ XY < A }- Similarly, we 
have A/Y = J2i x \ XY < A }- □ 

The following proposition shows that left residual and right residual are dual 
to each other. 

Proposition 10. Let S be a complete c-semiring. Suppose A,X,Y G S{{T>*)). 
Then we have (X\A) R = A R /X R and (A/Y) R = Y R \A R . 

Proof. Straightforward. □ 

By the above result, in the following, we often consider only one (either left 
or right) residual. Dual results can be applied to the other residual. 
Left residual has close connection with left quotient. 

Proposition 11. Let S be a complete c-semiring. Suppose A is a formal power 
series in S((T,*)), u is a word in E*. Then u~ l A is the largest language Y such 
that uY < A, i.e., u\A = u~ l A. 

Proof. Note that (u(u" 1 A))(9) = u~ 1 A(v) = A(uv) if 9 = uv and otherwise. 
It follows that u^- 1 ^) < A. If uY < A, then Y(v) = (uY)(uv) < A{uv) = 
(u~ 1 A)(v ) for any v G E*. Hence, Y < u~ x A. Therefore u~ 1 A is the largest Y 
such that uY < A. D 
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In the classical case, given two languages A, X over £, we always have 

X\A = fYu^AlueX} (35) 

A/X = p|{A« _1 |M e X}. (36) 

In the weighted case, residuals are usually not the intersection of a set of quotients 
by word. But we can still represent residuals in terms of quotients by word. Before 
give the details, we summarize some basic algebraic properties of the residuals. 

Proposition 12. Let S be a complete c-semiring. For A,X,Y <E S ((£*)), we have 

(i) X(X\A) < A, (A/Y)Y < A. 

(ii) The operations d,cr : S ((£*}} -► S ((£*}} defined by cl(X) = A/(X\A) 
and cr(Y) = (A/Y)\A are two closure operators, where r : £((£*)) — > 
^((S*}} is a closure operator if X < t(X), t(X x V X 2 ) = r{X 1 ) V r(X 2 ) 
andT{r{X)) = r(X). 

(Hi) (XY)\A = Y\(X\A), A/(YX) = (A/X)/Y. 

(iv) (X : © X 2 )\A = X ± \A A X 2 \A, A/{Y 1 ® Y 2 ) = A/Y x A A/Y 2 . 

(v) X\(A AB) = (X\A) A (Y\B). 

(vi) (A/(X\A))\A = X\A, A/((A/Y)\A) = A/Y. 

Proof. We give the proof of (vi), the others are straightforward. By (ii), X < 
A/(X\A), then it follows that (A/(X\A))\A < X\A. On the other hand, 
since A/(X\A)(X\A) < A, it follows that X\A < (A/(X\A))\A. Hence, 
(A/(X\A))\A = X\A. Similarly, we have A/((A/Y)\A) = A/Y. D 

We next give the characterization of residuals in terms of quotients by word, 
where — ¥ is the residual operation in the quantale S defined (cf. ©). 

Proposition 13. Let S be a complete c-semiring. Suppose X,Y,A G S((E*)). 
Then, for any v EY**,we have 

X\A(v) = /\{X(u)^A(uv)\ueE*} (37) 

A/Y(v) = f\{Y(u)^A(vu)\ueE*}. (38) 
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Proof. By Proposition \10\ we need only prove Eq.dTTT). 

For v G £*, let F(v) = /\{X(u) -> A(uu)|u G £*}. Then F is a series. We 
show Y = X\A, i.e., F is the largest series F such that XY < A. 

First, 

XY(w) = J2 X{u)Y{v) 

uv=w 

< J2 X(u)(X(u) ->• A{uv)) 

uv=w 

< ^2 M uv ) = A ( w )- 

uv=w 

Second, if XY < A, then, for any uv = w, X(u)Y(v) < A(uv). It fol- 
lows that Y(v) < X(u) ->■ A(uv) for any u G E*, thus, F(t>) < A( X H -► 
A{uv)\u e £*} = F(v), i.e., Y < Y. This shows that X\A = Y. D 

The following proposition shows that DWA-regular series are closed under 
residual operations. 

Proposition 14. Suppose S is a complete c-semiring, and A, X, Y G S* ((£*)). If 
A is DWA-regular, then so are X\A and A/Y. 

Proof. By Proposition [lOl we need only consider right residuals. Suppose that 
A = (Q, S, 5, q , F) is a DWA accepting A. Then we have \A\(6) = F(5*(q , 9)) 
for any 9 G S*. 

Define another weighted automaton, *4. y = (Q, S, S, qo, F Y ), where 

F Y (q) = /\{Y(u) -> F(^(g,«))|« G £*}. 

|„4 y |(£) = F y (^(g ,^)) 

= /\{Y(u)^F(5*(8*(q Q ,e),u)\ueV*} 

= /\{Y(u)^F(5*(q ,9u)\ueJ:*} 
= f\{Y(u)^A(9u)\ueZ*} 
= A/Y(9). 

Hence, A/Y is DWA-regular. □ 
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Then 



4.2. Factorizations of Formal Power Series 

In formal language theory, factorization is an important notion that is closely 



related to quotients and residuals [|25ll . This notion can be generalized to formal 
power series straightforwardly. 

Definition 5. For any X, Y e S{(£*)), if XY < A, then we call (X, Y) a sub- 
factorization of A. Furthermore, if the sub-factorization (X, Y) is maximal, i.e., 
if X < X', Y < Y' and X'Y' < A, then X = X' and Y = Y'. In this case we 
call (X, Y) a factorization of A, and write Ra for the set of all factorizations of 
A. 

The relationship between residuals and factorizations of a series is as follows. 

Proposition 15. Let S be a complete c-semiring. For A,X,Y<E S* ((£*)}, we have 

(i) (X, Y) G R A if and only if X = A/Y and Y = X\A. 

(ii) IfWZ < A, then there exists (X, Y) e Ra such that W < X and Z <Y. 

Proof, (i) Suppose (X, Y) G R A we show X = A/Y and Y = X\A. For any 
u, v G £*, we note that X(u) <S> Y(v) < A(uv) if and only if Y(v) < X(u) ->■ 
A[uv). Hence, Y(v) < /\ u& X(u) -> A[uv) = X\A(v). This shows that 
Y < X\A. Conversely, by X(X\A)(6) = \/ uv=e X(u) ® X\A(v) < A(8) and 
the maximality of the factorization, we know X\A < Y. Hence, Y = X\A. 
Similarly, we can show X = A/Y. 

On the other hand, suppose X = A/Y and Y = X\A. By definition, we 
know Y is the largest Z such that XZ < A, and X is the largest W such that 
WY < A. This shows that (X, Y) is a factorization of A. 

(ii) Let X = A/Z, Y = (A/Z)\A. It is clear that W < X. By Prop. E|(ii) 
and (vi), we know Z < (A/Z)\A and X = A/[(A/Z)\A] = A/Y. Therefore 
(X, Y) G R A and W < X and Z < Y. □ 

By the above proposition, a factorization of a formal power series A is just a 
pair (X, Y) such that X is the right residual of A by Y and X is the left residual 
of A by X. In this case, we also call X the left factor of A by Y and Y the right 
factor of A by X, respectively. Since sA = As = A, by Proposition [T51 (ii) A 
itself is both a left factor and a right factor. We denote the corresponding right 
factor and left factor by X s and Y e , respectively, where X s (e) = Y e (e) = 1, and 
call (X s , A) and (A, Y e ) the initial and final factorization, respectively. 
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We write IR(A) (rR(A)) for the set of left (right) residuals of A, i.e., 

IR{A) = {X\A\XeS((Z*))}, 
rR(A) = {A/Y\Y e 5((E*))}. 

Let cp : IR(A) -> rR(A) be the mapping defined as <p(X\A) = A/(X\A). By 
Proposition [T2l it is easy to see that 9? is a bijection. Moreover, we have 



R A = {{X,cp(X))\X E IR(A)} = {[tp-\Y),Y)\Y E rR(A)}. 

5. The Universal Weighted Automaton 

In this section, we use the residuals of a formal power series A to construct a 
weighted automaton which recognizes A. To this end, we introduce the notion of 
the inclusion degree. 

Definition 6. Suppose S is a complete c-semiring. For two S-subsets f,g : U ^ 
S, the inclusion degree of / into g, denoted by / — > ind g E S, is defined as 

/ ^ind 9 = /\{f(u) -)> g{u)\u E U}. (39) 

The following lemma summarizes several useful properties of the inclusion 
degree operator. 

Lemma 4. Suppose S is a complete c-semiring. For X,X' E S* ((£*)), any c E S, 
and any w E £*, we have 

(1) c<X ^ mcl X' iffcX < X'. 

(2) If(X, y), (X', Y') E R A , then X ^ mcl X' = Y> -+ incl Y. 

(3) X -^ ind X' = Xw -^i nc i X'w = wX -> ind wX'. 

Definition 7. Suppose S is a complete c-semiring. For A E S ((£*)), the universal 
weighted automaton of A, denoted by Ua, is a weighted automaton (Ra, S, Va, 
Ja,Ga), where 

J A (X,Y) = X(e), (40) 

G A (X,y) = Y{e), (41) 

^((^y),^^',^)) = XaY'^ incl A, (42) 

for any (X, Y), (X', Y') E R A , a E S. 
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Proposition 16. Suppose S is a complete c-semiring. For A G S ((£*)), and 

(X, Y), (X', Y') G RU an d a G E, we /zave 

X(e) = y^^A (43) 

y(e) = X-wA, (44) 

XaF'^ nd A = Xa^ mci l' = aF'^ mc ,y. (45) 

Proo/ Since (X, Y) G i? A , 

X(e)=.4/y(e) = f\{Y{v)^A(ev)\vel?} 

= /\{Y(v)^A(v)\veZ*} = Y^ md A. 

Similarly, we can prove the case for G A (X, Y). 

As for 7] a, it is sufficient to show that c < XoY' —>i nc i A iff c < Xcr 4„ c i 
X' for any c e S. This is because, c < XoY' -f in d A iff cXaY' < A, iff 
(cX«7)y' < A, iff da < X', iff c < Xa -> ind X'. Hence, Xay' -» ind A = 

X(T — ?-j n , c ; X . 

Similarly, we have XoY' — > ind A = oY' -^i nc i Y. O 

The extension of r\ has the following form. 

Proposition 17. Let S be a complete c-semiring and suppose A G S ((£*)). For 
(X, y), (X', y') G RU, and any w G S + , we have 

ti* a ((X, Y),w, (X', Y 1 )) = XwY' -> md A = Xw ^ incl X' = wY' ^ incl Y. 

(46) 

Proof. First, for any c G S, c < XwY' -^ incl A iff cXwY' < A, iff (cXw)Y' < 
A, iff cXw < X', iff c < Xw -> incJ X'. Hence, Iwl" -» incJ A = Xw -^ nc/ X'. 

Similarly, we have XwY' -^ ind A = wY' — y ind Y. 

We shall show rf A ({X, Y),w, (X', Y')) = XwY' -^ ind A by induction on the 
length |iu| for w G E + . 

If |w| = 1, this is just the definition of tja- 
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Given weE + and a E E, we show that (|46l holds for crw if (|46l ) holds for w. 

r) A {(X,Y),aw,{X',Y')) 

V VA ((X, Y), a, (X", Y")) ® V * A ((X", Y"),w, (X', Y')) 

(X",Y")eR A 

\J (XaY" ^ md A) <g> (X"wY' -> ind A) 

(X",Y")£R A 

V (Xa ^ md X") ® {X"w -> ind X') 

(x",y")eR, 4 

V (I™ -> inc , X"w) (8) (X"w -> ind X') 

(X",Y")6-Ra 

< /\ (Xo-w(^) -)• X"w(0)) <8> (X"w(0) -»• X'(0)) 

6»G£* 

< /\ (Xau>(#) -)• X'(0)) 

6>G£* 

= Xcrw; ->- ind X'. 

Conversely, 

c < Xaw -^ ind X' = XawY' -> ind A 
^^ cXawF' < A 
^^ (cXa)(wY') < A 

^^ there exists (X", Y") e ^ such that cXa < X", wF' < Y" 
-<=?- there exists (X", Y") € Ra such that c < Xa -^ nd X", 1 < wY' -^ ind Y", 

which implies 

c < (Xa^ ind X")®(wY' ^ ind Y") 
= [XaY" ^ ind A) ® (X"wY' ^ ind A) 
< V * A ((X,Y),aw,(X',Y')). 

Hence, Xaw -+ ind X' < Va ({X, Y), aw, (X', Y')). 

Therefore, the equality (|46l holds. □ 

We give some properties of universal weighted automaton as follows. 

Proposition 18. Let S be a complete c-semiring and suppose A G S ((£*)). For 

(X, Y) G R A , we have Past UA (X, Y) = X, Fut UA (X, Y) = Y. 
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Proof. For any 9 G £*, 

Past UA (X,Y)(9) = \J J A {X',Y')®r)*((X',Y'),9,(X,Y)) 

(X>,Y')€R A 

V X'{e) <g> (X'9 ^ md X) 

(X',Y')eR A 

= V x '& ® A ( x '^) -> *(«)) 

(X',y)e-RA «e s * 

< \/ X'(e) ® {X'9{9) -> X(0)) 

= \/ X'(e) (g) (X'(£) -> X(0)) 

(X',y)ei?A 

< *(0). 

On the other hand, 

Past UA (X,Y)(9) = \/ J A (X',Y')® V *((X',Y'),9,(X,Y)) 

(X',Y')dR A 

> J A (X S ,A)® V *((X S ,A),9,(X,Y)) 

= X s {e) ® (X s 9 ^ incl X) 

= X s 9 ^ incl X = /\ X s 9(u) -► X(u) 

USE* 

= /\ X s £(u) -+ X(u) A (X s 0(0) -)• X(0)) 

= /\(o ->*(«)) a (i->x(*)) 
= *(*)■ 

Hence, Past UA (X, Y) = X. 

Similarly, we have Fut UA (X, Y)=Y. U 

Theorem 1. Let S be a complete c-semiring and suppose A G S((E*)). Then we 
have \Ua\ = A. 
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Proof. For any 9 G S* 



\Ua\{0) = \/ Ja(X,F)®F^ a (X,F)(^) 

(X,Y)eR A 

\J X(e)®Y(6)<A(6). 

(X,Y)£Ra 

On the other hand, 

\Ua\{0) = V JA{X,Y)®Futu A {X,Y){0) 

{X,Y)&R A 

> J A {X S , A) ® Fw£ Wa (X s , A)(0) 
= X a (e)<g>,4(0) = A(0). 

Therefore, |ZYa| = A. D 

So far, we have defined two canonical weighted automata for each A G S ((£*)) , 
viz. the minimal DWA A4a and the universal weighted automaton Ua- Both au- 
tomata recognize A. Recall in the classical case, if A is a regular language over 
E, then M.a and Ua are both finite automata. This does not hold in general for 
weighted automata. In the following we discuss when Ua is finite. 

For AG S ((£*)), write 

S A = {c-> a\c G S, a G Im(A)}, (47) 

and let 

S^ = {/\X\XCS A } (48) 

be the /\-sublattice of S generated by Sa- Then it is well-known that S% is finite 
iff S A is finite (cf. Hi]). 



The following proposition shows the relationship between the finiteness of Ua 
and the finiteness of M.a- 

Proposition 19. Let S be a complete c-semiring. For A G S ((£*)), the following 
conditions are equivalent. 

(i) Ua is finite, i.e., Ra is finite. 

(ii) A can be accepted by a finite DWA, and Sa in Eq. ft47\) is finite. 

(Hi) M. A is finite, i.e., =a has finite index, and Sa is finite. 
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In particular, if S is finite c-semiring or a linear order lattice, the above con- 
ditions are equivalent, and the condition "Sa is finite" can be omitted. 

Proof. By Proposition|H A is recognized by a finite DWA iff =a has finite index. 
It remains to show that A has finite factorizations iff Sa is finite. 

Assume that A can be recognized by a finite DWA and Sa is finite. This 
implies that =a has finite index, i.e., Qa is a finite set. If U\ =a u 2 , then A(u\v) = 
A(u 2 v) for any v G E*. It follows that 

X{u 1 ) = A/Y{u 1 ) = /\{Y(v)->A( Ul v)\veZ*} 

= /\{Y(v)^A(u 2 v)\veJ:*} 
= A/Y(u 2 )=X(u 2 ). 

Thus X induces a unique mapping from Qa = S*/ =a into S^. Since Qa is 
finite and Sa is finite, the latter implies that the set S^ is also finite. Then the set 
of the mappings from Qa into S% is also finite. Therefore, Ra is finite. 

On the other hand, suppose Ra is finite. We first show M. A is a finite DWA. 
Note that by Theorem [Q A is accepted by the finite universal weighted automaton 
IAa- By Proposition l22l (the proof of which is independent to this proposition), 
M.A is a sub-automaton of IAa- Therefore, A can be accepted by a finite DWA. 

To end the proof, we show Sa is finite. We prove this by contradiction. Sup- 
pose Sa is infinite. Since Im(A) is finite, there is a G Im(A) such that the subset 
Si = {c — t- a\c G S} of Sa is infinite. Assume that A{u) = a for u G E*. For 
any c E S, define a series F c G 5((E*)) as, Y" c (w;) = c if u; = e and Y c (w) = 
otherwise. Consider the right residual A/Y c , by a simple calculation, we have 
A/Y c {u) = /\{Y c (v) -> A(uv)\v G E*} = F c (e) ->■ A(w) = c -> a. It fol- 
lows that the set {A/Y c \c G S} is infinite, then r.R(;4) is infinite, and thus Ra is 
infinite. A contradiction. Therefore Sa is finite. □ 

We give two examples to illustrate the construction of the universal weighted 
automaton of a formal power series. 

Example 1. Assume E = {a, b}, S = (N U {oo}, max, min, 0, oo), where S is 
a linear order lattice under the natural order of the integer numbers. Consider the 
formal power series A G 5((E*)) defined as follows, 

A(6) = { 2 ' if ^S*a6E* 
11, otherwise. 
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a, b 




Figure 1 : The DWA recognizes the formal power series A 

A can be recognized by the DWA A = (Q, E, 5, q , F) presented in Figure 1, 
where F = l/q + l/qi + 2/q 2 . 

The set of factorizations of A is Ra = {ui\ui = (Xi,Yi),i = 1,2,3,4.}, 
where X^O) = Y 2 (6) = 1, X 2 {9) = Fi(0) = 2, for all ^E*; 

( 2, if£eE*aE* 
3 ^ ' \ 1, otherwise. 






2, if#eE*afcE* 
1 , otherwis 

2, if#eE*6E* 
1 , otherwise. 

By definition, the universal weighted automaton of A is Ua = (Ra, ^,Va, 
J a ,Ga), where! 

- J a = \/u\ + 2/u 2 + I/us + l/w 4 , 

- G A = 2/«i + l/« 2 + l/«3 + l/«4, 

- Va(ui,x, Uj) is either 2 or 1, as shown in Figure 2. 

Example 2. Assume E = {a}, S — (N U {oo},min, +, oo, 0) is the tropical 
semiring. Consider the formal power series A G S((E*)} defined as follows 

i 0, if k = 

A(o fc ) 



fc-1, if fc > 0. 

By Proposition HI A can not be recognized by any finite DWA. However, 
as a regular series, A can be recognized by a finite weighted automaton B = 
({go, <?i}, E, ?7, {g }, {<?i}), where 77(30, a, q x ) = 0, r/(gi, a, g x ) = 1. The universal 
weighted automaton Ua has infinite states {(X i: ^)}~ , where 



2 We write x/ui for the value x of u, in the given S'-subset. 
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a/l,b/l 



a/l,b/l 




a/l,b/2 



a/2,b/2 



Figure 2: The universal weighted automaton Ua of the formal power series A 



Y = A,X (a k ) = k; 



and for i > 0, 



XAa k 



oo, if k = 

max(k — i,0), if A; > 0, 



Yi(a k ) = k, for any k > 0. 

For any i, j, we have 77y!((Xj, F,), a, (X^, Y,)) = if i < j + 1 and oo other- 
wise, J a = (X , Y ) and Ga = Ra \ J a- In this case, Ua is not a finite weighted 
automaton. 

6. The Universality of the Universal Weighted Automaton 

In this section, we show the weighted automaton Ua defined in the previous 
section satisfies the following universal property. 

Definition8. Supposed e S* ((£*)} and U is a weighted automaton that recognizes 
A. We say U satisfies the universal property if there exists a morphism from B to 
U for any weighted automaton B such that \B\ < A. 
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To demonstrate the universality of Ua, we introduce a canonical mapping for 
each weighted automaton B that recognizes a subset of A. 

Definition 9. Let S be a complete c-semiring. Suppose A G ^((E*}} and B = 

(P, E, 7], J, G) is a weighted automaton such that \B\ < A. We define tp B : P — >• 
-Ra by <y2g(p) = (X p , Vp) for any p <E P, where 

y p = Past B (p)\A and X p = A/F p . (49) 

We call tp B the canonical mapping from B to Ua- 

The following lemma shows that (p is a morphism. 

Lemma 5. Le? S be a complete c-semiring. Suppose A G S 1 ((£*)). If B = 
(P, E, 77, J, G) w a weighted automaton such that \B\ < A, then the canonical 
mapping ip B is a morphism from B into Ua- 

Proof. If^s(p) = (X p , Y p ), then it is obvious that Past B (p) < X p andP-utg(p) < 
lp. It follows that Ja(<Pb(p)) = X p (e) > Pastj3(p)(s) > J(p) andG r J 4(</?s(p)) = 

F p (£)>F M t B (p)(£)>G(p). 

For the remainder part, notice that 77 (p, a, q)Past B (p)a < Past B (q). Then 

rj(p,a,q)Past B (p)aY q < Past B (q)Y q < A, 

i.e., Past B (p)(rj(p,a,q)aY q ) < A. Hence, rj(p, a, q) a Y q < Y p . Then it follows 
that 

v(p> <?, <?) < °"^ ->md *p = va(v(p), o-, y? (<?))• 

Therefore, </?# is a morphism from £> into Z^- D 

The universality of Wa follows immediately. 

Theorem 2. Lef S be a complete c-semiring. For A G S((Y>*)), the universal 
weighted automaton Ua satisfies the universal property, i.e. there is a morphism 
to U a from any weighted automaton B such that \B\ < A. 

The following lemma establishes the connection between the formal power 
series accepted by two weighted automata connected by a morphism. 

Lemma 6. Let S be a complete c-semiring. Suppose A = (Q, E, 5, 1, F) and 
B = (P, E, 77, J, G) are two weighted automata. If tp is a morphism from A into 
B, then we have 

Past A (q) < Past B (<p(q)), Fut A (q) < Fut B (<p(q)), (50) 

for any q G Q, and thus, \A\ < \B\. If 'ip is a strong homomorphism, then \A\ = 

\B\. 
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Proof. For any 9 G E*, 

Past A (q)(8) = \/l(i)®6*(i,e,q) 



< V J(J)®V*(JA<p(q)) 



= Past B (<p(q))(6). 

Fut A (q)(9) = \j5*(q,$,t)®F(t) 

teQ 

< \fv*(<p(q),o,p)®G(p) 

peP 
= Fvt B (<p(q))(0)). 

Hence, Past A (q) < Past B ((f(q)) and Fut A (q) < Futs (<p(q))- Then it fol- 
lows that \A\ < \B\. 

If tp is a strong homomorphism, then it can be easily verified that 77* (tp(q) ,0,p) - 
\/{S*(q, 6, r)\ip(r) = p} for any 6 G E*. Then it follows that 

me) = V j(j)®v*(j,o,p)®g( p ) 

j,p&p 
= \/ I{i)®ri*(<p{i),e,p)®G(p) 

i£Q,p&P 

V I(i)®6*(i,9,r)®G(<p(r)) 

ieQ,ip(r)=p 

= \/ I(i) <g> 5*(i, 6, r) ® F(r) = \A\(0). 

i,reQ 

Hence, \A\ = \B\. D 

Suppose A = (Q, E, 5, 1, F) is a weighted automaton. We say two states p and 
q in Q are mergible in .4. if there exist a weighted automaton i3 = (P, E, 77, J, G) 
that accepts the same language as A and a surjective morphism cp : A — > B such 
that ip(p) =<p(q). 
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Proposition 20. Let S be a complete c-semiring. Suppose A G S((T,*)). Then 
there is no mergible states in the universal weighted automaton Ua- 

Proof. Otherwise, there is a weighted automaton C and a surjective moronism 
Lp : U A ->■ C such that \U A \ = \C\ = A, and ip(X, Y) = (p(X ( , Y') = s for two 
distinct states (X, Y) and (X', Y') in Ua- Then we have, 

X = Past UA {X,Y) < Past e (<f(X,Y)) = Past c {s), 
X' = Past UA (X'X) < Past c (<p(X',Y')) = Pastes), 

and thus, IVI'< Past c {s). Similarly, we have Y V Y' < Fut c {s). Therefore, 

(X V X')(Y V Y') < Past c (s)Fut c {s) < A. 

This contradicts with the maximality of the factorization (X, Y) and (X', Y'). □ 

In fact, Ua is the largest non-mergible weighted automaton. 

Corollary 1. Let S be a complete c-semiring. Suppose A G S((E*)). Then Ua is 
the largest weighted automaton among those that accept A but have no mergible 
states. 

Proof. A weighted automaton B accepting A that has strictly more states than Ua 
is sent into Ua by a morphism which is necessarily non-injective. □ 

Moreover, Ua is the smallest 'universal' weighted automaton. 

Proposition 21. Let S be a complete c-semiring. Suppose A G S((T,*)). Then 
Ua is the smallest weighted automaton among those that accept A and have the 
universal property. 

Proof. Suppose that C has the universal property with respect to the A. As Ua 
accepts A, there should be a morphism from Ua into C. As Ua has no mergible 
states, this morphism should be injective: C has at least as many states as Ua- □ 

Applying Theorem |2] to weighted automata that accepts A, we obtain the fol- 
lowing corollary. 

Corollary 2. Let S be a complete c-semiring. Suppose A G S 1 ((£*}} and B is 
a weighted automaton that accepts A. If B has no mergible states, then B is a 
sub-automaton ofUA- 
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Proof. By Theorem [H the canonical mapping y? from B to hi a is a morphism. 
Because B has no mergible states, we know ip must be one-to-one. Therefore, B 
is a sub-automaton of hi a- □ 

It is not difficult to show that any minimal weighted (determinate or non- 
determinate) automaton that accepts A has no mergible states. The above corol- 
lary then suggests a simple way for searching the minimal (non-determinate) 
weighted automaton that accepts A: It suffices to check the sub-automaton of 
the universal automaton Ua which accepts A and has minimal states. The fol- 
lowing proposition shows that AAa, the minimal DWA that accepts A, is also a 
sub-automaton of hi a- 

Proposition 22. Let S be a complete c-semiring. Suppose A G S((T,*)). Then 
M. A is a sub -automaton ojUa- 

Proof. By Corollary |2j we need only show that M. A has no mergible states. 
Recall the minimal DWA that accepts A is Ma = (Q,T,,5,qo,F), where 

- q = { u ~ l A\u e £*}, 

- 5(u- l A,a) = {ua)- 1 A, 

- 5*(u~ l A,v) = (uvY l A, 

- q = {e)~ x A = A, 

- F:Q^SisF(u- l A) = A{u). 

Then for any state u~ l A G Q, S*(A,u) = u~ x A. We show that there are no 
mergible states in A. Otherwise, there are two distinct states u~ x A, v~ x A in Q, 
but there exists another weighted automaton B and a morphism ip from A into B 
such that B is the morphic image of A |.A| = \B\ and ^(u^A) = tp(v~ l A). 

Since u~ x A ^ v~ x A, there exists w G S* such that u~ 1 A(w) ^ v~ 1 A(w), 
i.e., A(uw) 7^ A(vw). Note that 

A{uw) = \A\(uw) = F{5*{A,uw)) = F{5*{5*{A,u),w)) = F{5*{u^A,w)), 
A{vw) = \A\(vw) = F(5*(A,vw)) = F(5*(5*(A,v),w)) = F^iv^A, w)). 
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Then 

\B\(uw) = <p{F){5*{tp(A),uw)) 
= V (F)( v (5*(A,uw))) 

= V (20(«5*(v»(u-M), «;))) 

= ^FW&iv-'A)^))) 

= <p(F)(5*((p(A),vw)) 

= \B\{vw). 

Since \B\ = \A\ = A, it follows that A(uw) = A(vw), a contradiction occurs. 
Therefore, A has no mergible states. □ 

7. Construction of the Universal Weighted Automaton 

In general, it is not effective to construct all factorizations of A. Suppose 
A = (Q, E, 5, q , F) is an arbitrary DWA accepting A. In this section, we give an 
effective method to construct U A by using the DWA A. Let l A be the \/-sublattice 
generated by S^ as defined in Eq.(|47l), i.e., 

l A = {\JX\XCS$. (51) 

It is well known that l A is finite iff S^ is finite (cf.ll22l. I8IP iff S A is finite. Write 



Qi — l A . If A is finite and S A is finite, then Qi is also finite. We construct a 
weighted automaton A\ = (Qi, E, r}, J, G) as follows: 

J(f) = /(go), 

G(f) = f^inclF, 

v(f,<r,g) = fe^incig, 

where fa : Q —$■ l A is defined by fa(q) = \f{f(p)\5(p,a) = q}. 

We next define a mapping cp from A\ to U A . To this end, we first establish the 
correspondence between weighted states and factorizations of A. 

Proposition 23. Let S be a complete c-semiring. Suppose A G £((£*)) and A = 

(Q, E, 5, q , F) is an arbitrary DWA accepting A. Then (Xf, Yf) is a factorization 
of A for any weighted state f : Q — >• l A , where 

Yf = /\f{q)->Fut A (q), (52) 

X f = A/Y f , (53) 
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and, for any 9 E E*, 

(f(q) -> Fut A (q))(9) = f(q)->Fut A (q)(9). (54) 

Therefore, the mapping ip defined by </?(/) = {Xf, Yf) is a mapping from Qi = lj[ 
to R A . 

Proof. Without loss of generality, we assume that A is accessible. Since A is a 
DWA, for any q E Q, there exists u E E* such that S*(q ,u) = q. Moreover, if 
$*(qo, v ) — Q f° r another v E E*, then A(uw) = A(vw) for any w E E*. By this 
observation, we have, for any v E E*, 

Y(v) = /\f(q)->Fut A (q)(v) 

A /(«) ^ A ^ 

UG~E* ,8* (qo,u)=q 

= f\f(8*( q(h u))^A(uv). 

If we let X'(u) = f(5*(q , u)) for any u E E*, then we obtain a series X' : 
E* -► / A such that F = X'\A. D 

The mapping 92 : Z^ — >• Ra is also onto. 

Proposition 24. Le? S be a complete c-semiring. Suppose A E S((T,*)) and 
A = (Q,Hi,8,qo,F) is a DWA that accepts A. For any (X, Y) E Ra, there is 
a weighted state f : Q — > l A such that Y = Yf. 

Proof. Define a weighted state / : Q — > I a as, for any q E Q, 

f(q) = \J{X( U )\5*(q ,u) = q}. 

By the proof of Proposition [191 X induces a unique mapping from Q A = E*/ =a 
into S 1 ^, so / is well-defined. 

We show Y = Yf in the following. 
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For any 9 E £*, we have 

Yf(9) = /\f(q)^Fut A (q)(0) 

q&Q 

= /\ (\/{X(u)\6*(q , u) = q}) -> F(S*(q, 9) 

qeQ 

/\ X(u)->F(6*(q,9)) 

q&Q,S*(qo,u)=q 

= /\ X(u) -)• A{u9) 

= X\A{9) 
= Y(6). 

Hence, Y = Y f . D 

Furthermore, we have 

Proposition 25. Let S be a complete c-semiring. Suppose A e S ((£*)). T/?e 
mapping (p defined in Proposition [Z£] is a strong homomorphism from weighted 
automaton Ai = (Qi, E, rj, J, G) onto the universal weighted automaton IAa, and 
thus \A\\ = \Ua\ = A. 

Proof. See Appendix B. D 

Define an equivalence relation ~ on Q\ as follows: 

f~gffi<p(f) = <p(g) (55) 

It is clear that / ~ g iff Yf — Y g . Using this equivalence relation, we obtain a 
quotient weighted automaton from A\, denoted by A', which is isomorphic to IAa- 

Corollary 3. Let A e ^((S*}} and A\ be as in Proposition^^ Suppose A' is 
the quotient weighted automaton of A\ modulo the equivalent relation ~ on Q\. 
Then A' is isomorphic to Ua- 

Once the DWA A is finite and Sa is finite (this condition can be guaranteed if S 
is finite or S is a linear-order lattice as declared in Proposition [19), the equivalence 
~ defined by Eq.(l55l) can be effectively constructed. This is because, 5*(q,9) 
takes at most \Q\ = n states, i.e., the set {S*(q, 9)\9 e £*} as a subset of Q has at 
most n states, the corresponding Fut^(q) = GA(S*(q, 9)) has at most n values. 
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Therefore, it is sufficient to check these states in Eq.(|551). In turn, it is sufficient to 
check those 9 E S* with \9\ < n in Eq.(|55l). Hence, the equivalence relation ~ is 
decidable and the weighted automaton A' can be effectively constructed. 
We next give one example. 

Example 3. Consider the formal power series A in Example [Q which is recog- 
nized by the finite DWA as shown in Figure 1. Then the weighted automaton 
A' = (Q x , E, n, J, G), where Q 1 = {A, f 2 , f 3 , / 4 } with }\(q) = 1 and f 2 (q) = 2 
for any q E Q, 

2, q = qi,q2 

1, 9 = %■ 



fM 
fM 



2, q = g 2 
1, g = g , gi- 



and 



J = l// 1 + 2// 2 + l// 3 + l// 4 , 
G = 2/A + l// 2 + l// 3 + l// 4 ; 

and 7^(/j, x, /j) is either 2 or 1 (see Figure 3). Clearly, A' is isomorphic to Ua- 

We next give a detailed examination of the equivalent relation ~. 

The correspondence y? between the weighted states and the factorizations of 
A stated in Proposition [23] may be not one-to-one. There may have more than 
one weighted states correspond to a given factorization. However, the following 
proposition asserts that there exists a largest weighted states. 

Proposition 26. Let S be a complete c-semiring. Suppose A G S((E*)) and A = 

(Q, S, 5, g , F) is a DWA that accepts A. If Y = Y g . for all weighted states 
gi : Q — >• Ia{% € I), then Y = Y\j. 9i . Therefore, for each right residual Y, there 
exists a largest h : Q — >■ l A such that Y = Y h . 

By the above propositions, we know for each right residual Y of A there exists 
a (unique) largest weighted state h : Q — » I a such that Y = Y h . Furthermore, 
suppose (X,Y) e Ra- Then h is defined by h(q) = \f{X(u)\5*(q ,u) = q} as 
implied in the proofs of Propositions |23] and |24l In general, for a weighted state 
/ : Q —$■ Ia, the structure of the largest weighted state h such that Yf = Yh is 
unclear. But we have the following estimation. 
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a/l,b/l 



a/l,b/l 




a/l,b/2 



a/2,b/2 



Figure 3: The weighted automaton A' 

Proposition 27. Let S be a complete c-semiring. Suppose A = (Q, S, S, q , F) 
is a weighted automaton, and f : Q — >• I a a weighted state. If{ui} ieI C £* and 
Y f = Y A l€I uioF, then f < /\ ieI m o F, where u o F(q) = F(5*(q, u)). 

Proof. Let g = /\,. e/ Ui o F. Then for each j E I we have 



Y g ( Uj ) 



f\g{q)^Fut A {q){u )= /\ (/\ Ui o F) (q) 

qeQ qeQ iei 



{u J oF){q) = l. 



Thus /\ qeQ f(q) ->■ Fut A (q)( Uj ) = 1. It follows that f(q) -»■ Fnt^(g)(n j ) = 1, 
i.e., /(g) < Fut A (q)(uj) = Uj o F(q) for any q E Q. Therefore, / < Uj o F for 
any j, hence / < /\ ig/ w € o F. D 

Recall that if S 1 is the two elements Boolean algebra {0, 1}, then {/\ ieI Ui o 
F\ui E E*} forms the whole set of those largest elements (cf. D25|]). It is still 
unclear whether each largest weighted state can be represented as the intersection 
ofuioF for a set of u^. 

8. A Comparison of Quotients and Residuals 

For a formal power series A, we have introduced the notions of (left and right) 
quotients and (left and right) residuals of A. As can be seen in the above dis- 
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cussion, these two kinds of operations have different behaviors when considering 
their algebraic and language properties. Especially, with the associated weighted 
automata, Ba and Ua have different structure, although they are equivalent as lan- 
guage recognizers. For example, there exists series A such that Ba is infinite but 
Ua is finite. 

In this section, we consider the order relation between the quotients and the 
residuals of a same series A. Because the duality between left and right quotients 
(residuals), we need only compare the left quotient X~ X A and the left residual 
X\A of A by a series X. Our results show that all the four possibilities are 
possible. 

First, if X is a word u E S* or XLes* X(u) = 1 and A = 0, then it is obvious 
that X~ l A = X\A. 

Second, let S = {0, 1} be the two element Boolean algebra. Then for any 
languages X, A C S* we have 

X\A = p| u~ x A C (J u~ x A = X~ l A. 

u£X uex 

Moreover, X~ l A = X\A iff u =a v for any u, v E X; but if there exists u, v E X 
such that u ^a v, then the above inclusion is strict. 

Third, let S be the tropical semiring (N + U{oo}, min, +, oo, 0). For A E 
5((E*)), u E E*, and k E S, we have (ku)- l A = k(u~ l A) < s u^A, while 
(ku)\A > s u - M if k ^ and k ^ oo. Therefore (ku)\A > s {ku)~ l A if k ^ 
and k ^ oo. 

Fourth, let S be the tropical semiring (N + U{oo}, min, +, oo, 0). Take £ = 
{a, b}. Consider the formal power series A E S{(E*)) defined as follows 

0, if 9 = ba or 9 = bb 

oo, otherwise. 

Let X = mm((4 + a), 2 + b). We show X~ l A and X\A are incomparable. By 

X- l A(a) = mm(4: + A(aa),2 + A(ba)) = 2, 

X~ x A{b) = mm(4 + A(ab),2 + A(bb)) = 2, 

X\A(a) = max(A ->■ A(aa), 2 -> A(6a)) = 6, 

X\A(b) = max(4 -+ A(ab),2 -> A(66)) = 0, 



38 



we know X~ l A(a) > s X\A(a), but X~ l A{b) < s X\A(b). Therefore X~ X A 
and X\A are incomparable. 

It is still unclear when (i.e. for what kind of S and A E S ((T.*))) we will have 
an uniform order relation between X~ X A and X\A. 

9. Conclusions 

In this paper, we have defined the quotient and residual operations for formal 
power series. The algebraic and closure properties under these operations were 
discussed. Our results show that most nice properties are kept in formal power se- 
ries. Moreover, we introduced two canonical weighted automata M.a and Ua for 
each formal power series A using the quotients and, respectively, residuals of A. 
It was shown that M.a is the minimal DWA of A, and Ua is the universal weighted 
automaton of A which contains as a sub-automaton any weighted automaton that 
accepts A but has no mergible states. In particular, any minimal weighted (de- 
terministic or non-deterministic) automaton of A is a sub-automaton of Ua- This 
suggests an efficient way to find (approximations of) the minimal weighted NFA 
of A. Last but not least, we also showed, under a rather weak restriction, that Ua 
is finite iff M.a is finite, and that Ua can be effectively constructed when we have 
a finite DWA that recognizes A. 

There are still several open problems left unsolved. Suppose X and A are 
two formal power series. Is X\A regular (context-free) whenever A is regular 
(context-free)? What is the precise relation between X~ l A and X\A1 When 
characterizing residuals in terms of quotients by word, we require the underlying 
semiring to be a complete c-semiring. It is easy to see that this requirement is not 
necessary. Another problem then is, to what extent can we develop the related 
theory in a weaker semiring structure, e.g. in quantale? 

Another interesting question is to develop an abstraction scheme for formal 
power series and weighted automata based on semiring homomorphism. Just like 
in soft constraint satisfaction yi |2l|], we expect that semiring homomorphisms 



can play an important role in approximately computing the minimal NFA and the 
universal weighted automaton of a formal power series. 
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Appendix A. Proof of Propositon|7] 

Proof, (i) Suppose A = (Q, E, 5, /, F) is a weighted automaton accepting A. 
Then, for any 9 E E*, we have 

|.A|(0)= ]T 7(«,)(5*(gb,e,(z)F(g) = A(e). 

90,<?GQ 

Define another two weighted automata .Ax — (<2> E, S, Ix, F) and Ay = 
(Q, E, 5, J, Fy), where 

Ix(q) = Yl X ( u )H(lo)S*(qo,u,q), 

F y ( g )= ]T ^(9,1;,?)^)^). 

•ue£*,p€Q 
Then 



\Ax\(9) = Yl Ix(qiW( qi ,e,q)F(q) 
qi,q&Q 

J2 X(u)I(qo)6*(q , u, qi)S*(q u 9, q)F(q)) 

J2 I{qo)6*{q ,u6,q)F{q) 

ueS*,go,q£Q 

= s ^X{u)\A\{u6) = X- 1 A{6). 

mGS* 

\Ay\(0) = Yl nQo)5*(q ,e,q)F Y (q) 

<?0,<?6<2 

J2 I(qoW(q , 6, q)8*(q, v,p)F{p)Y(v) 
Y I(q )S*(q ,9v,p)F(p)Y(v) 

qo,p£Q,v£'E* 



Y\A{9v)Y{v) = AY-\d). 



dGE* 
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Hence, X~ 1 A = \Ax\, and AY^ 1 = \Ay\ are regular. 

(ii) Replace weighted automaton A in the proof of (i) by a DWA, we can prove 
that Ay -1 = \Ay\ is DWA-regular. 

Since A is DWA-regular, by Proposition @] there are n, • • ■ , r fc G S{0} and 
regular languages L\, ■ ■ ■ ,L k such that A = ^2 i=1 TiLi. By Proposition |6j X~ l A = 
Eti nX~ l Li. By Lemma|2l X^U = (Lf (I R )-y, it follows that X~ X U is 
DWA-regular for any i, and thus X~ l A is DWA-regular by Proposition @]again. 

(iii) Let Y\ = ^2 we %+(Y, w)w. Then Y = Y(e)e + Y\ and Y x is the proper 
part of Y. It is obvious that Y is regular iff Y\ is regular. By Proposition |6] 
AF" 1 = A(Y(e)e)- 1 + A(Yi)- 1 = AK(e) + AiY^" 1 . AY(s) is context-free 
since context-free languages are closed under scalar operation. To show AY" 1 
is context-free, it suffices to show that AYf 1 is context-free. Without loss of 
generality, we assume that Y is proper, i.e., Y(s) = 0. There exist a context free- 
grammar G = (V, E, P, S) and a weighted automaton A = (Q, E, 5, 90 , {<?/}) 
satisfying the conditions of Lemma[3l such that \G\ = A and |^4| = Y. 

Construct a new weighted context-free grammar G' = (V, E, P', S"), where, 
V" = E U (Q x E x Q), S' = (g , S, q f ), P' is constructed as follows, 

(ii-1) (g , x, go) — >• £ for each x G E; 
(ii-2) (g, x, g') A e if x G E and 5(q, x, q') = r; 

(ii-3) (g,x,g') 4 (g,Z/i,gi)(gi, 2/2,^2) • • • OZn-i,^,?') if a: 4 2/1Z/2 •■■J/n and 
gi,--- ,g n _i G Q. 

Let w G E*. We note that 

L(G')(w) = ^{ri®r 2 ®---(8)r fc |(3ai,--- ,a fc _i) 

[5" =4- ai =1- «2 =£■ • ■ • =^ ttfc-i 4w]} 
AY-\w) = ^{A(um)>»|wGE*} 

= y]{(rn ® r i2 ® • • • <8> ru) <8> (5(g , cti, gi) ® • • • ® 5(g m _i, cr m , g f )) 
(3«i, • • • , a^_ 1 )(3«Ti, • • • ,a m e S)(3g , gi, • • • , g m -i G Q) 
such that 5 =£ «i 4? • • • =^- wdi • • • cr m }. 

To show L(G')(w) = AY~ 1 (w), it suffices to show that they have the same 
non-zero sum-terms in S. That is, each non-zero sum-term r± ® r 2 ® • • • <8> r^ in 
the equality of L(G')(w) also appears in the equality of AY~ 1 (w) as a sum-term, 
and vise verse. 

On one hand, suppose there exists a sequence a.\, ■ ■ • , otk-\ such that 



r k-l r k 



nl t\ ro rt 'fe-i 

O =4> «l =4- Ct 2 =?• ■ • • =>- Ct!fc_l = 
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i.e., r = r!®r 2 (8>- • -0r k is anon-zero term in L{G'){w). Notice that the semiring 
S is assumed to be commutative and a production of type (ii-3) commutes with one 
of the type (ii-1) or (ii-2). The above sequence of productions can be rearranged 
so that all the productions of type (ii-3) precede those of type (ii-1) and (ii-2). 
Hence we may assume that by type (ii-3) productions 

S' = (q , S, qf ^ ai ^ • • • ^ a m (A.l) 

= (Qo,Vi,Qi)(<h.,V2,Q2)---(q n -i,Vn,tf), ( A -2) 

and by type (ii-1) and (ii-2) productions 

(<?o, 2/i, <?i)(<?i,£/2,<?2) ■••(<?«-!, £/n,</) ^ a m+1 "% 2 ■■■^w. (A.3) 

Since the induction (IA.3I) is by type (ii-1) and (ii-2), each yi is in E. Since 
every term in the induction (IA.21 ) corresponds to a production of P, it follows 
that there exists Pi, • • • ,/3 m such that S => p\ =$■ ■ ■ ■ =>• (3 m = y x y 2 ■ ■ ■ y n is an 
induction in G. Furthermore, for each i < n, we have either q^i = qi = q or 
8(qi-i, yi, qi) = r t for some m + 1 < t < k. Let j be the largest integer such that 
qj = go and let w — y\ ■ ■ ■ yj, u = yj+\ ■ ■ ■ y n - Because 5(q, a, go) = for any 
q E Q, it follows that g = 9i = • • • = Qj and q i+i ^ g for any i > j. Omitting 
the weight 1 by using the type (ii-1) productions, i.e., r m+1 = • ■ ■ = r m+ j = 1, it 
follows that the leaving terms, after rearranging, is 

r m+j+1 = 5(qj,y j+1 , q j+i ), ■■■ ,r k = 6(q n -i, y n , q' = qf 

and 

r m+j+1 <S> - ■ ■ <8 r k = r m+1 g) ■ • • <8> r k . 

This shows that the term ri®r 2 ®- ■ -®r k — (ri<8>- ■ ■®r m )®(r m+ i®- ■ -®r k ) = 
(ri Cg> • • ■ r m ) g) (r m+ j + \ (8) • • • g) rf) is also a term of AY~ 1 (w). 
On the other hand, assume that 

S ^ «i ^ ■ ■ ■ ^ wu (A.4) 

m G for w = xi ■ ■ ■ x t and u = 0\ ■ ■ ■ a m , and there exists states g , gi, • • • , g m = 
g/ in Q such that 

ri\ = S(q , o"i, gi), • ■ • , r 2m = <5(g m _i, <r m , g m ) and r 2 = r 2i 8> ■ ■ • <8> r 2m . (A.5) 

Then r — r±i g) • • • 8) r±i <8> r 2 i <8> • • • 8) r 2m is a term in the sum A7 _1 (w). Since 
the induction (IA.4I ) is in G, by type (ii-3) productions we have 

(g , xi, g ) ■ • • (g , x m , g )(g , a, gi) • ■ ■ (g m -i, o"m, <?/), 
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where q t , is chosen as in ( IA.5I ) for i > 1. 

Applying type (ii-1) productions to (g ,Xj,g ) an d type (ii-2) productions to 
(qi-i, yi, qi) we see that 

(g ,^i,go)---(go,^m,go)(go,o-,gi)---(gm-i,o- m ,g/) ^ ■■■ r ^ w . 

Hence, r xl (g) r 12 <g • • • <g r^ (g) r 2 i <g) • • -®r 2m is a term in the sum of L{G'){w). 

Therefore, L{G'){w) = AY~ l (w) for any w E £*. Therefore, L(G') = AF" 1 
and AY^ 1 is context-free. 

Since S is commutative, by the duality between left and right quotients, it 
follows that X~ l A is also context-free once X is regular and A is context-free. 

(iv) By the proof of statement (iii), we have the following simple observation: 
If A is a DWA in the proof of statement (iii), i.e., A is a classical deterministic 
finite automaton with a unique final state. Then the commutativity of S is not 
necessary in the proof of the above proposition. This is because, in this case, the 
weights in type (ii-1) and (ii-2) productions take values 1, and a production of type 
(ii-3) commutes with one of type (ii-1) or (ii-2). In this case, if we let Y = \A\, 
then AY -1 is context-free. 

For a general finite DWA A = (Q, S, 5, q , F), we write Aj = (Q, S, 5, q , {q}) 
for a finite DWA with unique final state q for any state q in Q. If we let Y q = \A q \, 
then AY^ 1 is context-free by the above observation. By a simple calculation, we 
have Y — \A\ — J2 Q eQ ^g-^X'?)- Then, by Proposition[6](ii), we have 

ay- 1 = A^Y.mr 1 = E^r 1 )^)- 

q&Q q£Q 

Since AY^ 1 is context-free for any q E Q and the family of weighted context-free 
language is closed under scalar product and finite sum, it follows that AY^ 1 is 
context-free. 

Similar to the proof of statement (ii), X~ l A is context-free if X is DWA- 
regular and A is context-free. This shows that the statement (iv) holds. □ 

Appendix B. Proof of Proposition l25l 

Proof. Let us first show the following equality holds, 

Y g -> incl (/\ /\ f(p)^Fut A (q)) = aY g ^ md Y f . (B.l) 

gSQ 5(p,a)=q 
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Consider D = a(f\ qeQ A 5{p , a)=q f(p) -> Fut A (q)). 
If u ^ crv for any u G E*, then D(w) = 0. 
If u — av for some v E E*, then 

£>(«) = A A f(p) ^ Fut A (q)(v) 

q€QS(p,a)=q 

= A A /(?)-+ *w?>«)) 

geQ<5(p,cr)=(j 

= A A /(?)-> *w?><"0) 

q€Q8(p,a)=q 

= f\f(p)^F(8*(p,u)) 

p&Q 

= /\f(p)^Fut A (p)(u)=Y f (u). 

p&Q 

Noting that if u does not have the form av for any v E E*, then erl^(u) = 0. 
Thus, 

Y g ^incl(/\ A f(p)^ Fut A<l)) 

q&Q 5(p,a)=q 

= aY g ^ ind a(/\ /\ f(p)-+Fut A (q)) 

q£Q S(p,a)=q 
— °Yg -^incl D = oY g -^-incl Yf. 

Next, let us prove the following equality 

aY -> incJ 17 = \/{/<7 "^«i 9\Y g = Y}. (B.2) 

On one hand, suppose c < fa — >md # for some c G L and F = F 9 . Then we have 

c Cg> /o-(g) < g(q) for any q E Q. Therefore, g(q) -> Fut A (q) < c® fu(q) — > 
Fut A (q) = c — y (fa(q) —y Fut A (q)) for any q E Q. Hence, 

f\(g(q) ^ Fut A (q)) < f\(c^(fa(q)^Fut A (q)) 

q&Q q&Q 

= c ^(/\fa(q)^Fut A (q)). 
q&Q 
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This further implies that 

c < (/\g(q)^Fut A (q))^ incl (/\fa(q)^Fut A (q)) 

q&Q q&Q 

= Y g ^ mcl (/\ /\ f(p)^Fut A {q)) 

q&Q S{p,a)=q 
= oY g -±i n cl Yf. 

This shows that fa -> ind g < aY g -^ incl Y f . 

On the other hand, let X'f(u) = f(5*(q ,u)). By Proposition [231 we know 
X' f < X f . Thus, 

&Y g -^-ind Yf = XfO —t-ind X g < XjCT -¥ind X g . (B.3) 

We next show 

X' f a -*i nc i X g < fa -> ind g, (B.4) 

for some weighted state g (in fact, the largest weighted state g such that Y g = Y), 
where g is defined by, 

g(q) = \J{X(u)\5*(q ,u) = q}. 

By Proposition [211 g satisfies Y g = Y. Then 

o~Y —^i nc i Yf = aYg —^i nc i Yf < Xfa — »j nc j X g < fa -^i nc i g, 

and then Eq.(E2l) holds. 

The proof of Eq. (IB.4l) is as follows. 
Note that 

X a -^ind Xg = X a -^ind X 

= f\ X'a(u) ->■ X(u) 

= /\ X\v) -> X{va) 

< /\ f(S*(qo,v)) ^ g(8*(q ,va)) 

= f\f(q)^ 9 (5(q,a)). 

q&Q 
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and 

fo- ^ind 9 = /\ fcr(q) -> g(q) 

q&Q 

= /\{\/{f(p)\8(p,<r) = q})^g(q) 

qeQ 

= A( A f(p)->9(8(p,cr)) 

qeQ 8{p,a)=q 

= /\f(q)^g(S(q,a)). 

q&Q 

We know Eq. (|B.4| ) holds. 

We next show that cp also satisfies the following two conditions: 

J A (X,Y) = \J{J(f)\Y = Y f }, (B.5) 

GaW)) = G(f). (B.6) 

For Eq.(|B3]), we have J A (X,Y) = X(e), and Y = Y f , then J(f) = f(q ) = 
f(S*{q , e)) = X'(e) < X{e). If we let X f = X, and thus J(f) can take X f (e), 
this shows that Eq. (|B.5l) holds. 



For Eq.(|B.6|), we have 










G A (<p(f)) = 


G A (X f , 


yj) 


= Y f {e) 

q&Q 

= /\f(q)^ 

q&Q 

q&Q 

J 'incl r 


Fut A (q)(e 
F(5*(q,e) 
F(q) 
= G(f)- 



Eq. (IB.2l) . Eq. (IB.5l) . and Eq. (IB.6l) imply that ip is a strong homomorphism from A\ 
onto U A , and then \A\\ = \U A \ = A. O 
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